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Abstract - We consider optimization of the average entropy production in inhomogeneous tem- 
perature environments within the framework of stochastic thermodynamics. For systems modeled 
by Langevin equations (e.g. a colloidal particle in a heat bath) it has been recently shown that 
a space dependent temperature breaks the time reversal symmetry of the fast velocity degrees 
of freedom resulting in an anomalous contribution to the entropy production of the overdamped 
dynamics. We show that optimization of entropy production is determined by an auxiliary de- 
terministic problem describing motion on a curved manifold in a potential. The "anomalous 
contribution" to entropy plays the role of the potential and the inverse of the diffusion tensor is 
the metric. We also find that entropy production is not minimized by adiabatically slow, quasi- 
static protocols but there is a finite optimal duration for the transport process. As an example 
we discuss the case of a linearly space dependent diffusion coefficient. 



Introduction. — The last decades have witnessed a 
tremendous development in our abilities to fabricate arti- 
ficial devices on the micro- and nanometer scale, and to 
manipulate and monitor biological and soft matter sys- 
tems. Out of the numerous evidences for this progress 
we mention just two remarkable examples, the realization 
of a micrometer-sized Stirling-engine [T] and the verifi- 
cation of Landauer's principle [5] using a colloidal parti- 
cle in a double-well potential to represent the information 
memory. Both these examples link small non-equilibrium 
systems, in which diffusive processes due to thermal fluc- 
tuations play a dominant role, to concepts well-known 
from macroscopic classical thermodynamics. The theo- 
retical basis for this connection is provided by stochastic 
thermodynamics, a framework which systematically ex- 
tends thermodynamic quantities such as exchanged heat, 



applied work [3] or entropy production to individual fluc- 
tuating trajectories @]. For the distribution functions of 
such quantities, exact general results can be obtained, the 
Jarzynski relation being probably the most prominent ex- 
ample [5]. 

For both the above mentioned experimental examples 
[HE], it is well-known that optimal bounds exist in the 
limit of adiabatically slow modulation of the system: the 
Carnot efficiency for the Stirling engine pQ, and the Lan- 
daucr bound for information erasure [2]. However, is it 
possible to find an optimal time-dependent "control" (re- 
alized by external forcings) so that a specific quantity of in- 
terest becomes optimal during a process which takes only 
finite time? Within the framework of stochastic thermo- 
dynamics, this question has first been posed by Seifert 
[B] in order to minimize the mean work applied to a col- 
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loidal particle in a laser trap and to calculate efficiency 
of finite-time working cycles [?]■ Afterwards it has been 
further extended to more general optimization problems 
in a number of publications, see e.g. [BTU4]. 

All these studies have been performed for systems in 
contact with a single heat bath at constant temperature. 
In many cases of interest, however, especially when con- 
sidering Brownian and molecular motors (see for example 
[SHEjIHH]), transport is induced by systematically chang- 
ing the temperature in time and/or by generating temper- 
ature gradients. A recent work [T7] considered the case of 
a time varying (though spatially homogeneous) tempera- 
ture which is used as an additional control parameter. In 
the present Letter we study optimal finite-time processes 
in the presence of temperature gradients by optimizing 
the total entropy production [T3] of a system described 
by Langevin equations. In doing so, we take into account 
that, if temperature is not homogeneous in space, the cor- 
rect expression for the entropy production in the strong 
friction limit is not simply given by the overdamped ap- 
proximation of the entropy production functional, but has 
an additional "anomalous" contribution stemming from a 
symmetry breaking of the fast velocity degrees of freedom 
induced by the temperature gradient [18]. 

In an earlier work, it has been shown that for a con- 
stant diffusion matrix, the control which optimizes heat 
or work is essentially given by the solution of an auxiliary 
problem described by deterministic transport according to 
Burgers equation [10]. However, this is not the case any 
more if temperature is space dependent. We will show here 
that optimization of entropy production in inhomogeneous 
temperature environments can still be mapped into a de- 
terministic transport problem. Furthermore, we find that 
for constant temperatures but space dependent friction co- 
efficient the auxiliary problem is equivalent to finding the 
geodesies on a curved manifold, where the metric tensor 
is the inverse of the diffusion matrix. 

Entropy production in inhomogeneous media. 

We consider driven diffusive motion in an inhomogeneous 
temperature environment modeled by the Langevin equa- 
tion 
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where we have allowed temperature T(x) and friction coef- 
ficient y(x) to be space-dependent with stationary profiles. 
The first term f(x,t)/j(x) on the right-hand side repre- 
sents the external deterministic driving forces acting on 
the particle, while the last term y l /2T(x)/j(x) r)(t) models 
the impact of thermal fluctuations by unbiased Gaussian 
white noise with correlations (rf (t)r) J (s)} = 6^S(t — s) 
(we set Boltzmann's constant to unity). This multiplica- 
tive noise term is interpreted in the non-anticipative Ito- 
convention. The unusual contribution TV7 -1 is a con- 
sequence of space-dependence of friction [19) and results 



from the small-inertia limit of the underlying Langevin- 
Kramers dynamics [50]. The inhomogeneous heat bath 
is assumed to locally fulfill Einstein's relation D(x) — 
IT(x)/j(x) for the diffusion matrix D(x), which is pro- 
portional to the identity matrix I. 

In the following, we briefly recapitulate known prop- 
erties of the entropy production associated with diffusive 
motion according to (P) . It can be shown that the entropy 
production in the environment is given by the sum of two 
terms: a regular one and an anomalous one |18| . The 
regular one is defined as the log-ratio of the probability 
P of a specific forward path, which is a solution x(t) of 
([l}, to the probability P for the occurrence of the back- 
ward path in the time-reversed overdamped dynamics |21] . 
The anomalous contribution accounts for the breaking of 
time-reversal symmetry in velocities, induced by the tem- 
perature gradient. It appears in the limit of vanishingly 
small inertia of the full Langevin-Kramcrs dynamics, but 
would be overlooked in the naive overdamped approxima- 
tion when setting mass to zero |18] . The entropy produc- 
tion in the environment thus reads 
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where the integral is along the path x(t) and the product 
labeled by the open circle has to be evaluated according to 
the midpoint rule (Stratonovich convention). Note that in 
addition to the entropy production f /T as an effect of the 
external forces there is also a regular contribution — VT/T 
from the spatial change of temperature along the path. 
The entropy of the system itself is defined as [32] 



S sys = -]np(x,t) 
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where p(x,t) is the solution of the Fokker-Planck equa- 
tion associated with ([T]) . The total entropy production (in 
the system and the environment) along the path x(t) is 
therefore given by 
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Averaging |4]) over many realizations of the path x(t) with 
given distribution po(xo) = p(xv,t = 0) of the initial 
points xo = x(t = 0), we find the quantity of main in- 
terest, the total average entropy production (Stot)- It can 
be written as 



(Stot) = y o dtivD-'v 
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where n is the dimensionality of x and r denotes the time 
at which the path x(t) ends. The first term represents 
the regular entropy production, the second term is the 
anomalous contribution [18j . To obtain the specific form of 
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the regular part from the expression in (U), we have made 
use of the Fokker-Planck equation for p(x,t) associated 
with (J]), which can be written in form of the transport 
equation 



with the current velocity j23l[24] 
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and using the partial integration "trick" (V/i) = 
— (h V In p) , which is valid for arbitrary functions h = 
h(x,t) (bounded at infinity). Note that if temperature 
is constant (the regular case with VT = 0), the average 
total entropy production ([5]) is simply a quadratic form of 
the current velocity [21"] . 

From expression ([5]) it is clear that the average entropy 
production is largely determined by the evolution of the 
distribution of paths x(t). Extremal entropy production 
therefore requires a specific "optimal" evolution of paths. 
Such "optimal" evolution can be imposed on the system 
by applying a suitable time-dependent protocol [6] to con- 
trol (parts of) the external potentials and forces. In our 
model UJ, the external control is incorporated into the 
term /(x,t) by its explicit time-dependence. 

In the remainder of the paper, we study the conditions 
under which the total average entropy production ([5]) be- 
comes extremal. This optimization problem is typically 
subject to constraints, in particular the distribution po{xo) 
of initial points is usually prescribed. Other additional 
constraints may be present as well, like a specific final dis- 
tribution p(x,t = t) or a specific value of the control at 
final time r. 

Optimization of entropy production. We now 

study the problem of optimizing the average entropy pro- 
duction (Stot)j which is of the general form 



(St, 
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where L contains the regular part of the entropy produc- 
tion and the anomalous one, 



L = (D- 1 ) ij (x)v i v j - U(x) 



(9) 



The "potential" term is given by the anomalous entropy 
production 

(n + 2) dT dT 
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The first step in our analysis consists in rewriting the av- 
erage in (|5|) over many realizations of the path along which 
the integral is performed into an equivalent average over 
the distribution p(x,t), obeying ([5]), 

(St*) = / dx J dtL(x(t),v(x(t),t),t)p(x,t) (11) 

dx p (x ) J dtL(Z(t;x ),£(t;x ),t) . 



In the second step we have used the formal solution 
p(x,t) = / dx 5(x - £,(t;x ))p (x ) 



(12) 



of the Fokker-Planck equation ©, where £(t;xo) solves 
the auxiliary deterministic dynamics 



i(t;x ) =v(£(t;x ),t) 
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and Po{xq) is the distribution of the path starting points 
Xq. As already mentioned, po is typically specified by the 
problem at hand. The optimal average entropy production 
is thus obtained by extrcmizing the time-integral 



dtL(S(t;x ),£(t;x ),t) 



(14) 



in the second line of (|11[) for any given initial point Xq- 
This corresponds to a standard variational problem for the 
auxiliary trajectories £(t;xo), with the "trajectory- wise" 
entropy production (fT4")l being identical to the cost func- 
tion [TJ]. The integrand £, i), as specified in ©, can 
be interpreted as the "Lagrange-function" of the problem. 
It contains a kinetic-like term (D -1 )^^ 1 ^ in curved space 
and a potential-like term U. The metric of the space is 
equivalent to the inverse of the diffusion coefficient, 
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The optimal solutions £(t;xo) of this variational problem 
solve the Euler-Lagrange equations 



with the Christoffel-Symbols T l - kl defined as Y l - k 
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The relation (|16l) and its implications for optimal 
stochastic transport are the main results of this paper. 
Wc remark that if the temperature profile is homogeneous 
the anomalous contribution vanishes (U = 0) and mini- 
mization of the entropy production is equivalent to finding 
the geodesies for free deterministic motion in a space with 
metric tensor (fl"5|) . 

According to (fT2"j) and (fTB")) the optimal density p(x, t) is 
transported along these auxiliary trajectories with a local 
velocity which corresponds to the current velocity (J7J) at 
this point. It is remarkable that the auxiliary determin- 
istic dynamics (|16[) on the curved manifold can be fully 
described in terms of the current velocity. Once the aux- 
iliary problem is solved, the external protocol acting on 
f(x,t) has to be adapted to generate the optimal trans- 
port according to the solution of (fTB]) . 

Since the Euler-Lagrange equation (fT6|) is a second- 
order differential equation, we need — in addition to the 
initial point Xo — a second condition to obtain a unique 
solution, e.g., we need to fix the initial velocity or an inter- 
mediate point along the trajectory. This freedom can be 
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used to meet the additional constraints of the optimization 
problem. For instance, to reproduce a given final density 
p(x, t) we may choose the final points £(t; xo), so that the 
relation p(x,r) = fdx S(x — £(t;x ))p (x ) is fulfilled. 
In that case, for a constant temperature (no anomalous 
potential term) , the optimization problem is equivalent to 
an optimal assignment problem mapping the initial den- 
sity po(xo) to the final one p(x, r) with the quadratic cost 
function J dxo po{xo) J dt (D -1 )^^ 1 ^ [12]. If, however, 
no additional constraints are specified we can exploit the 
freedom of choosing a second condition for the solution of 
(1161) to perform a further optimization step over the final 
densities p(x, r). 

Example: one-dimensional motion for a linear 
diffusion coefficient. — In order to highlight the influ- 
ence of an inhomogeneous temperature it is instructive to 
study the one-dimensional transport of a Brownian par- 
ticle between given initial and final states (as introduced 
by Seifert and Schmiedl in [7]). We will here compare 
two cases: the anomalous one of a linear temperature pro- 
file and a regular one where temperature is constant but 
friction is space dependent. We know that the latter sit- 
uation is solved by geodesies. The difference between the 
two cases gets more marked as the transport time increases 
and the process is closer to quasi-static operation. 

In one dimension, the auxiliary equation of motion (| 16|) 
reads 

where we remark that in the regular case of constant tem- 
perature the potential term vanishes (U = 0). Since (fT7|) 
(like its general counterpart (jTSJ) ) is obtained from extrem- 
izing a "Lagrange- function" © , we actually face a Hamil- 
tonian dynamics with preserved "energy" (D~ 1 )ij£ > ' l £ > : > +U . 
Therefore, (fTTj) can be easily solved for the quadratic ve- 
locity with the result 
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where C is an integration constant corresponding to the 
conserved "energy". For the thermally inhomogeneous 
study case we choose a linear temperature profile and a 
constant friction coefficient 

T(x) = T + tfx, 7 = 70 , (19) 

with constant temperature gradient In order to avoid 
non-physical zero or negative temperatures we restrict to 
positions larger than x nlin = ~T /$. For the case of space- 
dependent friction we can define 

To 



T = T n 



7(2) 



1 



(20) 



- W x 

Therefore, in both cases, we have the same space depen- 
dent diffusion coefficient 

T + dx 




Fig. 1: Optimal trajectory between position xo = and and 
x T — 1 as a function of time for To = 1, ■& = 1, 70 = 1. The 
dotted line refers to the case without the entropic anomaly and 
the solid line to the anomalous case of inhomogeneous temper- 
ature, while the reference dashed line indicates the arrival po- 
sition x T . Top: transport in a time r = 1. Bottom: transport 
in a time r = 10. 

but only for the space-dependent temperature profile the 
second term in (|18[) contributes, representing the anoma- 
lous entropy production. With these definitions, the right- 
hand side of (fT5|) is linear in £ and can be solved explicitly 
with a solution that is quadratic in time: 



£(i; x ) = x - (x + X) - 

T 



[ - 



with 



A' 
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(22) 



,(23) 



and the prescribed initial position ^(0;xq) = xq and final 
position £(t;xq) = x r . where for the sake of simplicity 
we have considered x T > xq (i.e. motion towards the 
hotter region)0. In (|23[> . we have introduced the charac- 
teristic parameter \ to distinguish between the anomalous 



D(x) 



To 
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x By i 12:>[ ) the motion starts with a positive velocity. There is a 
second solution with a plus sign replacing the minus sign in front 
of the square root so that motion starts with negative velocities. It 
is easy to verify that these solutions maximize the average entropy 
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case with inhomogeneous temperature (setup (fTT)]) . \ = 1) 
and the regular one with constant temperature but space- 
dependent friction (setup (f20|) . \ = 0). Actually, the term 
involving \ m the square root represents —t 2 DU coming 
from (Tgj). 

Beside its dependence on the parameters that define 
the specific system (like Tq, i?, and 70), and on the ini- 
tial and final positions xq, x t , this optimal solution also 
depends on the process duration r. In the absence of 
the anomalous contribution to the entropy production 
(x = 0); this dependence corresponds to a trivial rescal- 
ing of time. The optimal trajectory then is a parabola 
with positive curvature x T + X\ x= q, independent of pro- 
cess duration. In presence of the anomaly (x = 1), how- 
ever, the evolution of £(i; Xq) depends on r also via X and 
can change qualitatively. For processes that take exactly 
t = \f2{x T — a;o)7o/i9, the solution f(i;xo) is a straight 
line, while it is a parabola with a positive (negative) con- 
cavity for shorter (longer) process durations. Interestingly, 
for very slow processes with 



T > T .. 



T 

X )(X T + -j) 



(24) 



the optimal trajectory even overshoots the target position 
at x T and eventually changes direction to finally reach it. 
Such a counter-intuitive behavior can be traced back to 
the influence of the anomalous contribution to the "cost" 
of the optimal trajectory. 

In the present case, the entropic cost of the optimal 
evolution reads (see eqs. ©, {(THJ) , (© and ([15]) ) 



Si = 



dt [C - 2tf(0] 



At 



4 7o I , v\ 



X 



T + ^ 



, (25) 



where in the second step we have used the explicit form 
(fl9|) of the linear temperature profile. The first term of 
the integrand of the cost is constant whereas the second 
one depends on the position £. In fact, the instantaneous 
cost is lower at high temperatures which, in this case, are 
reached for large values of £. When the transport time is 
fixed and long it can therefore be profitable to spend part 
of it where the anomalous term is less costly even though 
this is away from the target. 

It is now interesting to consider the dependence of the 
total cost on the duration of the transport operation r 
(Fig. [2J . Naively we would expect a slow, quasi-static pro- 
cess (long r) to be less dissipativc and therefore associated 
with a lower entropy production. For the non-anomalous 
setting of constant temperature this is indeed the case (see 
fT"2"] ) as we have 



c ( \ 4 T° I 
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production. However, this maximizing trajectory, if unconstrained, 
visits unphysical regions of positions corresponding to negative tem- 
peratures. 
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Fig. 2: Optimal cost between position xo = and and x T = 1 
as a function of process duration r for To = 1, # = 1, 70 = 1. 
The dotted line refers to the case without the entropic anomaly 
(solved by geodesies) and the solid line to the anomalous case 
of inhomogeneous temperature. The reference dashed line in- 
dicates the minimum cost for the anomalous case achieved for 
a time r = ^^T^ 70 = s/2. 



When a temperature gradient is present the situation 
changes drastically as the anomalous contribution in- 
creases with the process duration and the minimum cost 
is achieved at finite time. For the discussed linear temper- 
ature profile the optimal cost reads 
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where we recall that X| x= i also depends on r as specified 



in (|23|) . This expression is not a monotonic decreasing 
function of r and therefore, there is a finite valued r min- 
imizing it: 

„ _ V2(x T - 2:0)70 



d 



(28) 



It is interesting to note that this optimal duration of the 
protocol depends inversely on the intensity of the gradient 
and corresponds to the case in which the solution of (l22t 
is a straight line. Furthermore, considering (|24p . we can 
see that the overshooting of the final target takes places 
for transport times that are longer than the optimal ones 

= 2j x r l +To J^ T* > 2t*. Before moving to the con- 



elusion we wish to recall that, although the solutions 
are sufficient to assess the optimal transport duration and 
highlight several peculiarities of the optimal protocol in 
presence of temperature gradients, they still depend on 
the explicit evolution of the probability density (via the 
current velocity) . In order to have a complete solution for 
the protocols one has to consider the specific initial distri- 
bution and solve the corresponding assignment problem. 
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Conclusion. — We have shown that the optimization 
of entropy production for driven diffusion processes in an 
inhomogeneous temperature environment can be mapped 
into an auxiliary deterministic transport problem describ- 
ing motion on a curved manifold. The metric tensor of the 
manifold is given by the inverse of the diffusion matrix. 
Contributions to the entropy production due to the "en- 
tropic anomaly" [18] play the role of a potential energy for 
the auxiliary deterministic dynamics on the curved mani- 
fold. In non-anomalous cases the optimization reduces to 
the solution of geodesies. Recently, geodesies were found 
as optimal solutions in control parameter space for ex- 
cess power in [14j within a linear response analysis, and 
for slowly varying protocols driving a particle in a har- 
monic potential in [T7]. Using the simple example of one- 
dimensional diffusion in a linear temperature gradient, we 
demonstrated that optimization of entropy production in- 
cluding the anomaly requires finite processing times which 
are inversely proportional to the gradient. In contrast, for 
regular settings (homogeneous temperature), the optimal 
average entropy production is reached in the quasi-static 
limit of adiabatically slow operation. We have also shown 
that for slow transports the anomalous optimal trajectory 
is markedly different from the regular one and may display 
non trivial features such as overshooting of the final target. 
We have here presented the details in the case of a space- 
dependent temperature and friction coefficient. However, 
temperature and viscosity (friction) variations with time 
can be treated along similar lines, the main difference to 
our central result (|16[) being an additional term from the 
time-derivative of the metric tensor. 
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